Day-ahead scheduling based on reinforcement learning with hybrid action space

نویسندگان

چکیده

Driven by the improvement of smart grid, active distribution network (ADN) has attracted much attention due to its characteristic management. By making full use electricity price signals for optimal scheduling, total cost ADN can be reduced. However, day-ahead scheduling problem is challenging since future unknown. Moreover, in ADN, some schedulable variables are continuous while discrete, which increases difficulty determining scheme. In this paper, formulated as a Markov decision process (MDP) with continuous-discrete hybrid action space. Then, an algorithm based on multi-agent reinforcement learning (HRL) proposed obtain The adopts structure centralized training and decentralized execution, different methods applied determine selection policy discrete variables. simulation experiment results demonstrate effectiveness algorithm.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Operation Scheduling of MGs Based on Deep Reinforcement Learning Algorithm

: In this paper, the operation scheduling of Microgrids (MGs), including Distributed Energy Resources (DERs) and Energy Storage Systems (ESSs), is proposed using a Deep Reinforcement Learning (DRL) based approach. Due to the dynamic characteristic of the problem, it firstly is formulated as a Markov Decision Process (MDP). Next, Deep Deterministic Policy Gradient (DDPG) algorithm is presented t...

متن کامل

Deep Reinforcement Learning in Parameterized Action Space

Recent work has shown that deep neural networks are capable of approximating both value functions and policies in reinforcement learning domains featuring continuous state and action spaces. However, to the best of our knowledge no previous work has succeeded at using deep neural networks in structured (parameterized) continuous action spaces. To fill this gap, this paper focuses on learning wi...

متن کامل

Autonomous Ramp Merge Maneuver Based on Reinforcement Learning with Continuous Action Space

Ramp merging is a critical maneuver for road safety and traffic efficiency. Most of the current automated driving systems developed by multiple automobile manufacturers and suppliers are typically limited to restricted access freeways only. Extending the automated mode to ramp merging zones presents substantial challenges. One is that the automated vehicle needs to incorporate a future objectiv...

متن کامل

Reinforcement Learning Algorithm with CTRNN in Continuous Action Space

There are some difficulties in applying traditional reinforcement learning algorithms to motion control tasks of robot. Because most algorithms are concerned with discrete actions and based on the assumption of complete observability of the state. This paper deals with these two problems by combining the reinforcement learning algorithm and CTRNN learning algorithm. We carried out an experiment...

متن کامل

Deep Reinforcement Learning with an Unbounded Action Space

This paper introduces a novel architecture for reinforcement learning with deep neural networks designed to handle state and action spaces characterized by natural language, as found in text-based games. Termed a deep reinforcement relevance network (DRRN), the architecture represents action and state spaces with separate embedding vectors, which are combined with an interaction function to app...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Chinese Journal of Systems Engineering and Electronics

سال: 2022

ISSN: ['1004-4132']

DOI: https://doi.org/10.23919/jsee.2022.000064